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Abstract 

We search for lepton flavor and lepton number violating r decays into a lepton (i = electron or 
muon) and two charged mesons {h,h' = vr^ or K^), t~ —>■ l~h'^h'~ and t~ — > i^h~h'~, using 
671 fb~^ of data collected with the Belle detector at the KEKB asymmetric-energy e~^e~ collider. 
We obtain 90% C.L. upper limits on the branching fractions in the range (4.4 — 8.8) x 10~^ for 
r — > ehh' , and (3.3 — 16) x 10~^ for r — > fihh' processes. These results improve upon previously 
published upper limits by factors between 1.6 to 8.8. 

PACS numbers: ll.30.Fs; 13.35.Dx; 14.60.Fg 



3 



INTRODUCTION 



Lepton flavor violation (LFV) in charged lepton decays is forbidden or highly suppressed 
even if neutrino mixing is included. However, LFV appears in various extensions of the 
Standard Model (SM), such as supersymmetry, leptoquark and many other models 
aaai. Some of these models predict branching fractions which, for certain combinations 
of model parameters, can be as high as 10"^; these rates are already accessible in high- 
statistics 5-factory experiments. Here, we search for r decays [|] into one lepton = 
electron or muon) and two charged mesons {h, h' = vr^ or K^) including lepton flavor and 
lepton number violation (r~ — > i~h~h'~^ and r~ i~^h~h'~) with a data sample of 671 
fb~^ collected at the T(4S') resonance and 60 MeV below with the Belle detector at the 
KEKB asymmetric-energy e~^e~ collider j^. Previously, we reported 90% confidence level 
(C.L.) upper limits on these LFV branching fractions using 158 fb~^ of data; the results 
were in the range (1.6—8.0) x 10"'' [13]. The BaBar collaboration has also obtained 90% 
C.L. upper limits in the range (0.7—4.8) x 10"'^ ll|. using 221 fb~^ of data 

The Belle detector is a large-solid-angle magnetic spectrometer that consists of a silicon 
vertex detector (SVD), a 50-layer central drift chamber (CDC), an array of aerogel threshold 
Cherenkov counters (ACC), a barrel-like arrangement of time-of-flight scintillation counters 
(TOF), and an electromagnetic calorimeter comprised of CsI(Tl) crystals (ECL), all located 
inside a superconducting solenoid coil that provides a 1.5 T magnetic field. An iron flux- 
return located outside the coil is instrumented to detect mesons and to identify muons 



(KLM). The detector is described in detail elsewhere [12 . 

Particle identification is very important for this measurement. We use hadron identi- 
fication likelihood variables based on the ratio of the energy deposited in the ECL to the 
momentum measured in the SVD and CDC, the shower shape in the ECL, the particle range 
in the KLM, the hit information from the ACC, the dE/dx information in the CDC, and 
the particle time-of-flight from the TOF. To distinguish hadron species, we use likelihood 
ratios, V{i/j) = Ci/{Ci + Cj), where Ci (Cj) is the likelihood for the detector response 
to a track with flavor hypothesis i (j). For lepton identification, we form likelihood ratios 
V{e) and V{fi) [3] based on the electron and muon probabilities, respectively, which 



are determined by the responses of the appropriate subdetectors. 

In order to estimate the signal efficiency and optimize the event selection, we use Monte 
Carlo (MC) simulated event samples. The signal and background events from generic T~^r~ 
decays are generated by KKMC/TAUOLA [15|. For the signal MC sample, we generate 
r+r~ pairs, where one r decays into a lepton and two charged mesons, using a three- 
body phase space model, and the other r decays generically. Other backgrounds, including 
BB and continuum e+e~ QQ {q = u, d, s, c) events, Bhabha events, and two-photon 
processes are generated by EvtGen Q, BHLUMI [13] , and AAFH [3, respectively. The 



event selection is optimized mode-by-mode since the backgrounds are mode dependent. All 
kinematic variables are calculated in the laboratory frame unless otherwise specified. In 



[t] Throughout this paper, charge-conjugate modes are imphed unless stated otherwise. 
[I] The notation "t £hh' " indicates both — > £~'h^h'~ and t~ — > £'^h~h'~ modes. 
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particular, variables calculated in the e~^e center-of-mass (CM) system are indicated by 
the superscript "CM". 



EVENT SELECTION 



Since the majority of r decays produce one-prong final states [19|, we search for t~^t~ 
events in which one r (the signal r) decays into a lepton and two charged mesons (vr^ or K^) 
and the other r (the tag r) decays into one charged track with any number of additional 
photons and neutrinos. Candidate r-pair events are required to have four tracks with zero 
net charge. 

We start by reconstructing four charged tracks and any number of photons within the 
fiducial volume defined by —0.866 < cos^ < 0.956, where 6 is the polar angle relative to the 
direction opposite to that of the incident e"*" beam in the laboratory frame. The transverse 
momentum {pt) of each charged track and the energy of each photon {E^) are required to 
satisfy Pi > 0.1 GeV/c and -E^ > 0.1 GeV, respectively. For each charged track, the distance 
of the closest point with respect to the interaction point is required to be less than 0.5 cm 
in the transverse direction and less than 3.0 cm in the longitudinal direction. 



Using the plane perpendicular to the CM thrust axis [20|], which is calculated from the 
observed tracks and photon candidates, we separate the particles in an event into two hemi- 
spheres. These are referred to as the signal and tag sides. The tag side contains one charged 
track while the signal side contains three charged tracks. We require one charged track on 
the signal side to be identified as a lepton. The lepton identification criteria are 'P(^) > 0.95 
and the momentum thresholds are listed in Table [B The electron (muon) identification 
efficiency is 91% (85%) while the probability to misidentify a pion as an electron (a muon) 
is below 0.5% (2%). In order to take into account the emission of bremsstrahlung photons 
from the electron, the momentum of each electron track is reconstructed by adding the mo- 
mentum of every photon within 0.05 rad along the track. To reduce generic t~^t~ and qq 
background events, we veto events that have a photon on the signal side. 

To ensure that the missing particles are neutrinos rather than photons or charged particles 
that pass outside the detector acceptance, we impose requirements on the missing momentum 
Pmiss; whlch Is calculatcd by subtracting the vector sum of the momenta of all tracks and 
photons from the sum of the e"*" and e~ beam momenta. We require that the magnitude 
of Pmiss be greater than 1.0 GeV/c, and that its direction point into the fiducial volume of 
the detector. Furthermore, we reject the event if the direction of the missing momentum 
traverses the gap between the barrel and endcap of the ECL. Since neutrinos are emitted 
only on the tag side, the direction of Pmiss should lie within the tag side of the event. The 
cosine of the opening angle between Pmiss and the charged track on the tag side in the CM 
system, cos ^{^^g.j^jgg, should be in the range 0.4 < cos 6'^ag_jjjjss < 0.98. 

The remaining two tracks on the signal side are identified as K"^ (vr''^) if they satisfy the 
condition V{K/7r) > 0.8 (< 0.4). If either track has a value in the intermediate range, 0.4 < 
V{K/n) < 0.8, the event is rejected. The kaon (pion) identification efficiency is 80% (88%) 
while the probability to misidentify a pion (kaon) as a kaon (a pion) is below 10% (12%). 
In order to reduce background from mesons reconstructed from photon conversions (i.e. 
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TABLE I: Selection criteria for lepton momentum {pi) and magnitude of thrust (T). 



Mode 


pe (GeV/c) 


T 


T 


— > /.ivrvr 


Pi, > 1.4 


0.90 < T < 0.97 


T 


— > flKlT 


Pf, > 1.1 


0.92 < T < 0.98 


T 


fj.KK 


P^ > 0.8 


0.92 < T < 0.98 


T 


evTTr 


Pe > 0.6 


0.90 < r < 0.97 


T 


— > eKn 


Pe > 0.4 


0.90 < T < 0.97 


T 


eKK 


> 0.4 


0.90 < T < 0.98 



7 — > e"'"e~), we require that two charged meson candidates have V{e) < 0.1. Furthermore, 
we require V{fJ,) < 0.1 to suppress the two-photon background process e+e~ — > e+e~/i+/i~. 

To reject qq background, we require the magnitude of the thrust (T) to be in the ranges 
given in Table[I](see Fig.[I](a) and Fig. [2] (a)). We also require 5.5 GeV < E^^ < 10.0 GeV, 
where E^^ is the total visible energy in the CM system, defined as the sum of the energies 
of the lepton, two charged mesons, the charged track on the tag side (with a pion mass 
hypothesis) and all photon candidates (see Fig. [1] (b)). The invariant mass reconstructed 
from the charged track and any photons on the tag side mt^g, is required to be less than 
1.00 GeV/c^ (see Figl2] (b)). In order to reduce qq background, a kaon veto Vi^K/n) < 0.8 
is applied to the lepton and tracks on the tag side for the finK and fiKK modes. 

We remove events if Kg candidates are reconstructed from two oppositely-charged tracks 
on the signal side with an invariant mass 0.470 GeV/c^ < Mt^+tt- < 0.525 GeV/c^, assuming 
the pion mass for both tracks, and the tt+tt^ vertex is displaced from the interaction point 



(IP) in the direction of the pion pair momentum 2l|]. Events including a meson also 
constitute background since the undetected results in fake missing momentum. There- 
fore, we veto events with candidates, which are selected from hit clusters in the KLM 
that are not associated with either an ECL cluster or with a charged track 221], for the fihh' 
modes. 

To suppress the BB and qq background, we require that the number of photons on the 
tag side n^^^ be n^'^'^ < 2 and n^^^ < 1 for hadronic and leptonic tag decays, respectively 
(see Fig. [3]). For all kinematic distributions shown in Figs. [H [2] and [3l reasonable agreement 
between the data and background MC is observed. 

To reduce two-photon background, we apply an electron veto V{e) < 0.1 to the track on 
the tag side for the ctttt and enK modes. Furthermore, we require that the momentum of 
the electron and track on the tag side in the CM system be less than 4.5 GeV/c to reduce 
Bhabha background in the evrvr modes. 

Finally, to suppress backgrounds from generic t~^t~ and qq events, we apply a selection 
based on the magnitude of the missing momentum Pmiss and the missing mass squared 
m^jgg. We apply different selection criteria depending on the lepton identification of the 
charged track on the tag side; two neutrinos are emitted if the track is an electron or muon 
(leptonic tag) while only one is emitted if the track is a hadron (hadronic tag). For the ehh', 
film and fiKK modes, we require the following relation between Pmiss and m^jg^: Pmiss > 
— 7.0 xm^jgg — 1 and Pmiss > 7.0xm^-gg — 1.0 for the hadronic tag and Pmiss > — 8.0xm^jgs+0.2 
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FIG. 1: Distribution of (a) the magnitude of thrust and (b) the total visible energy in the CM 
system. While the signal MC (r~ K~^K~) distribution is normalized arbitrarily, the data 

and background MC are normalized to the same luminosity. The selected regions are indicated by 
the arrows. 
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FIG. 2: Distribution of (a) the magnitude of thrust and (b) invariant mass using particles on the 
tag side. While the signal MC (r~ yU^vr^vr^) distribution is normalized arbitrarily, the data 
and background MC are normalized to the same luminosity. The selected regions are indicated by 
the arrows. 



and Pmiss > 1-8 x m^j^g — 0.4 for the leptonic tag, where Pmiss is in GeV/c and mmiss is in 
GeV/c^ (see Fig. Hj). For the finK modes, we require the following relation between Pmiss 
and m^igg! Pmiss > —8.0 x m^jgg — 0.5 and Pmiss > 8.0 x m^jgg — 0.5 for the hadronic tag and 
Pmiss > —9.0 X m^jgg + 0.4 and Pmiss > 1-8 x m^jgg — 0.4 for the leptonic tag. 
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FIG. 3: Distributions of the number of photons on the tag side for (left) hadronic and (right) 
leptonic tags. While the signal MC (r~ — > /i~7r+7r~) distribution is normalized arbitrarily, the data 
and background MC are normalized to the same luminosity. The selected regions are indicated by 
the arrows. 



SIGNAL AND BACKGROUND ESTIMATION 

The signal candidates are examined in the two-dimensional plot of the ihh' invariant 
mass {Mihh') versus the difference of their energy from the beam energy in the CM sys- 
tem (AE"). A signal event should have Mih^i close to the r-lepton mass (m^) and 
close to zero. For all modes, the Mihh' and AE resolutions are parameterized from fits to 
the signal MC distributions, with an asymmetric Gaussian function that takes into account 
initial-state radiation. The resolutions in Mihw and Ai? are listed in Table [Tll 

To evaluate the branching fractions, we use elliptical signal regions that contain 90% of 
the MC signal events satisfying all selection criteria. We blind the data in the signal region 
until all selection criteria are finalized so as not to bias our choice of selection criteria. 

For the ehh' modes the dominant background is from two-photon processes; the fraction 
of qq and generic t^t~ events is small due to the low electron fake rate. For the /xTTTr mode 
the dominant background is from qq processes and a smaller background is from generic 
r+r~ events in the AE < GeV and M^tttt < region, which are combinations of a 
fake muon and two pions. For the ^ttK mode, the dominant background is from generic 
T^T~ events that are combinations of a fake muon, a fake kaon and a true pion. If a pion 
is misidentified as a kaon, the reconstructed mass from generic t^t~ background can be 
greater than the r lepton mass because of the larger kaon mass. For the fiKK mode, the 
dominant background originates from qq events and t~^t~ events. 

The number of background events in the signal region is estimated from the data remain- 
ing after event selection in the sideband region. For the ehh' and fiKK modes, since the 
number of remaining data events is small, the number of background events in the signal 
region is estimated by interpolating the number of observed events in the sideband region 
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(a)T' ^/i'7T*7T' (Hadronic tag) 



(b) generic t*t' MC (Hadronic tag) 
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((gWc^^)^) 

FIG. 4: Scatter-plots of Pmiss vs. m'^^^^: (a) and (b) show the signal MC (t~ — yU^vr+vr^) and 
generic t^t" MC distributions, respectively, for the hadronic tags while (c) and (d) are the same 
distributions for the leptonic tags. The selected regions are indicated by lines. 



defined as the range ±200"*/^^^, and ±5aAE excluding the signal region, assuming that the 
background distribution is uniform in the sideband region. For the /ivrvr and fiirK modes, 
we estimate the number of background events in the signal region by fitting to observed 
data in the sideband region using a probability density function (PDF) that describes the 
shapes of the background distributions along the M^tttt axis within iSaAE- For the /ivrvr 
mode, the PDFs of generic rr and qq events are determined using MC samples, assuming 
exponential and first-order polynomial distributions, respectively (see Fig. [5]). For the fiTiK 
modes, we parameterize the PDF by a 3rd-order polynomial function that is fitted to the 
data remaining in the sideband region. The signal efficiency and the number of expected 
background events in the signal region for each mode are summarized in Table IIIII 

The dominant systematic uncertainties for this analysis come from tracking efficiencies 
and particle identification. The uncertainty due to the charged track finding is estimated to 
be 1.0% per charged track; the total uncertainty due to the charged track finding is 4.0%. 
The uncertainties due to lepton identification are 2.2% and 1.9% for electron and muon, 
respectively. The uncertainty due to pion and kaon identification is 1.3% and 1.8% per pion 
and kaon, respectively. The uncertainty due to the e-veto on the tag side applied for the 
T evTTr and r eirK modes is estimated as the uncertainty in the electron identification 
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TABLE II: Summary of M^hh' and resolutions (f^M^J^^, (MeV/c^) and a^p (MeV)). Here 
(jhigh ^(jiow-j j]2gans the standard deviation on the higher (lower) side of the peak. 



Mode 




^low 


high 


—low 

C^AE 




—5- /x^vr" 




4.8 


5.5 


13.7 


18.0 




— > /_f+7r" 




5.3 


5.4 


14.1 


18.8 


r" 


^ e^vr^ 


"vr^ 


5.3 


5.9 


14.7 


21.2 


T~ 


e+TT' 


"vr^ 


5.6 


5.9 


14.2 


21.3 


T~ - 


fi-R-- 




3.6 


4.0 


11.4 


18.0 


T~ - 


fi+K' 




3.4 


3.6 


11 /i 

11.4 


18.8 


T~ - 


e-R-^ 




4 n 


4 3 


1 3 7 


20 5 


T~ - 


e+K- 


-K~ 


3.5 


4.5 


13.9 


21.3 


T~ - 


-> /U~7r'+ 


K~ 


4.5 


5.0 


13.6 


18.6 


T~ 


— > e~7r^ 




4.7 


5.4 


13.6 


21.7 


T~ - 


li~K 




4.6 


5.1 


14.3 


18.3 


T~ 


— > e /\ +7r 


4.6 


5.5 


13.5 


21.6 


T~ - 


Ix+K 


vr 


4.5 


5.0 


12.4 


18.6 


r~ 


e+K 




4.9 


5.3 


13.0 


20.8 



times the branching fraction of r~ e~v^v.^ (0.4%). The uncertainties due to MC statistics 
and luminosity are estimated to be (2.5 — 3.4)% and 1.4%, respectively. The uncertainty 
due to the trigger efficiency is negligible compared to the other uncertainties. All these 
uncertainties are added in quadrature giving total systematic uncertainties for all modes in 
the (5.9 - 6.8)% range. 



UPPER LIMITS ON THE BRANCHING FRACTIONS 

Finally, we examine the data in the signal region and observe two candidate events for the 
fi~7r+K~ mode, one candidate event for each of the fi~K+7i~ , fi+7r~K~ and e"^7r~7r~ modes, 
and no candidate events for the other modes. These numbers of events are consistent with 
the expected numbers of background events. Since no statistically significant excess of data 
over the expected background is observed, we set the followin g up per limits on the branching 



fractions of r ^ ihh' based on the Feldman- Cousins method [23|]. The 90% CL. upper limit 



on the number of signal events including a systematic uncertainty (sgo) is obtained using 



the POLE program without conditioning 2J] based on the number of expected background 



events, the number of observed events and the systematic uncertainty. The upper limit on 
the branching fraction (B) is then given by 
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TABLE III: The signal efficiency (e), the number of expected background events (A^bg) estimated 
from the sideband data, the total systematic uncertainty (cTgyst), the number of observed events in 
the signal region (Nq^s), 90% C.L. upper limit on the number of signal events including systematic 
uncertainties (sgo) and 90% C.L. upper limit on the branching fraction for each individual mode. 



Mode 


e{%) 


Nbg 


O-syst (%) iVobs 


S90 


B (10-«) 






3.69 


1.12 ±0.38 


5.9 





1.53 


3.3 


T~ 




3.84 


0.73 ±0.25 


5.9 





1.77 


3.7 


T~ 


— > e^vr+vr^ 


3.99 


0.34 ±0.15 


6.0 





2.15 


4.4 


T~ 


— > e^TT^TT^ 


3.91 


0.10 ±0.07 


6.0 


1 


4.21 


8.8 


T~ - 


fi~K+K~ 


2.40 


0.52 ±0.23 


6.7 





1.92 


6.8 


T~ - 


n+K~K~ 


2.07 


0.00 ± 0.06 


6.8 





2.46 


9.6 


T~ - 


e-K+K~ 


3.50 


0.11 ±0.08 


6.5 





2.35 


5.4 


T~ - 




3.28 


0.05 ± 0.05 


6.6 





2.43 


6.0 


r~ - 




2.63 


0.67 ±0.14 


6.3 


2 


5.05 


16 


T~ 
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6.3 


1 


3.34 


10 


T~ 


— > e~K^Tr~ 


2.98 


0.57 ±0.19 


6.4 





1.90 


5.2 


T~ - 




2.61 


1.37 ±0.21 


6.3 


1 


3.16 


9.4 


r~ 


— > e^K^TT^ 


2.83 


0.10 ±0.07 


6.4 





2.40 


6.7 



where A'^^,- is the number of r^r~ pairs, and e is the signal efficiency. The value A^,-,- = 616.6 x 
10® is obtained from the integrated luminosity times the cross section for r-pair production, 
which is calculated in the updated version of KKMC [25| to be cTt-t = 0.919 ± 0.003 nb. 
Table IIIII summarizes information about the upper limits for all modes. We obtain the 
following 90% C.L. upper limits on the branching fractions: B{t ehh') < (4.4 — 8.8) x 10~^ 
and B{t fihh') < (3.3 — 16) x 10~^. These results improve upon previously published 
upper limits by factors of 1.6 to 8.8 [iG . 



SUMMARY 

We have searched for lepton-flavor and lepton-number-violating r decays into a lepton 
and two charged mesons {h, h' = or K^) using 671 fb~^ of data. We found no excess of 
signal in any of the modes. The resulting 90% C.L. upper limits on the branching fractions, 
B{t ehh') < (4.4 - 8.8) x 10"^ and B{t jjhh') < (3.3 - 16) x 10-^ improve upon 
previously published results by factors of 1.6 to 8.8. These more stringent upper limits can 
be used to constrain the parameter spaces in various models of new physics. 
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Background 
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FIG. 5: Mass distribution of ;U~7r+7r~ within the ztScr^^; region after event selection. While the 
signal MC (r~ — > //"vr+vr") distribution is normalized arbitrarily, the data and background MC 
are normalized to the same luminosity. The expected background is shown as the solid histogram. 
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the MC signal distribution with arbitrary normalization. The elliptical signal regions shown by 
the solid curves are used for evaluating the signal yield. 
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